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Summary 

The characteristics of Walsh-Hadarmrd transformation systems are examined 
with a view to reducing the data rate of digital television signals. Transformed signals 
have been measured using several different transformation arrangements by means of a 
Walsh spectrum analyser, in which television signals are correlated with Walsh functions. 

It is found that a slightly higher data rate is required to describe the transform 
coefficients with linear coding than is needed for the original signal. However, a more 
efficient encoding of the transform could be provided using non-linear quantisation or 
adaptive bit-rate reduction systems. Two-dimensional transformation and the use of 
sampling frequencies which concentrate the energy of colour signals in the transform 
could improve the performance of these bit-rate reduction systems. 
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HADAMARD TRANSFORMATION: 

WALSH SPECTRAL ANALYSIS OF TELEVISION SIGNALS 

C.K.P. Clarke, B.Sc.{Eng.), A.C.G.I. 



1. Introduction 

The conversion of television signals into pulse code 
modulation (p.c.m.) greatly improves their immunity to 
distortion. However, the p.c.m. signal typically consists of 
samples taken at a rate of 13-3 MHz, each of which is 
coded using an eight-digit binary word. Therefore, the 
data rate of the p.cm. signal is 106-4 Mbits"'. A reduc- 
tion of this data rate without noticeable degradation of 
picture quality would produce a corresponding saving in the 
capacity required for distribution links and the amount of 
magnetic tape used in recording. 

All methods of bit-rate reduction convert the p.c.m. 
signal into a new set of codewords containing, on average, 
fewer binary digits. After transmission, an inverse conver- 
sion is used to return the signals to p.cm., although, because 
of the bit-rate reduction, some combinations of p.cm. 
words cannot be reproduced without error. If picture 
quality is to be preserved, then either the effect of the errors 
must not be noticeable, or the combinations of p.c.m. 
words which would produce noticeable errors must never 
occur. 

For television signals, more efficient coding methods 
can be found by first identifying the respects in which the 
p.c.m. signals are redundant and then designing codes which 
reduce the redundancy. The following two examples 
illustrate redundancy in the p.c.m. signal. 

First, eight-bit p.c.m. words are required to avoid 
'contouring' in plain areas of the picture, but fewer bits 
could represent detailed areas adequately. This is because 
the detail disguises quantising errors. Secondly, in plain 
areas adjacent samples are similar in value, so that only 
those parts of the code that represent small differences 
change from word to word. 

This suggests a code which transmits small differences, 
which occur in plain areas of picture, with high precision 
and large differences, which occur in detailed areas, with 
reduced precision. Differential pulse-code modulation 
systems use this principle. 

Another approach is to separate the parts of the signal 
representing the plain and detailed areas so that each may 
be described with the optimum number of bits. Plain areas 
correspond to low frequencies in the signal and detailed 
areas correspond to high frequencies. Therefore, the two 
typesof signal could be separated by Fourier transformation. 
However, Hadamard transformation also separates signals 
representing plain and detailed areas of picture and involves 
simpler calculations. 

Both Fourier and Hadamard transformations represent 
the signal as a set of amplitudes of orthogonal functions. 
In Fourier transformation, these are harmonically related 



sinusoidal functions, whereas in Hadamard transformation 
they are rectangular waveforms. In the most commonly 
used Hadamard transformation, known as Walsh- Hadamard 
transformation, the orthogonal functions are sets of Walsh 
functions. 

Walsh functions may take only the values +^ and —1, 
and it is this property which makes Hadamard transfor- 
mation easier to implement than Fourier transformation. 
Walsh functions are distinguished by the number of tran' 
sitions between these values in a given interval; this 
number is known as the sequency of the function. When 
placed in order of increasing sequency, the set of transform 
coefficients of the Walsh-Hadamard transformation is known 
as the sequency spectrum of the signal. 

A large number of different sequency spectra can be 
produced by arranging the television signals for transfor- 
mation in different ways. The object of the work des- 
cribed in this report was to find the transformation 
arrangements which are most beneficial for subsequent bit- 
rate reduction. For some simple methods, the savings to 
be made can be calculated by considering the properties of 
the transformation and making measurements on the 
sequency spectrum of the signals. This report first presents 
some of the theory of Hadamard transformation as a means 
to the bit-rate reduction of transformed signals. This is 
followed by a description of the Walsh correlation methods 
used to measure the sequency spectra of different trans- 
formations. Finally, the results for different transfor- 
mation arrangements are presented and considered. 



2. Hadamard transformation 

2.1. Theory of the transformation 

Hadamard transformation is defined by the matrix 
equation: 



h. 



■■■\ 
... h 



2n 



h h h 



or c = Hx 



where X and C represent input and output n-dimensional 
vectors and H represents an (n x n) Hadamard matrix. A 
Hadamard matrix has two properties: it is orthogonal, 
that is: 



HH^ = «I 



(2) 
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where H^ represents the transpose of H, and 1 represents 
the {n X n) unit matrix; the elements of the Hadamard 
matrix may take only the values +1 or —1, that is: 



/2- = ±1 



/= 1, 2, ...,«;/= 1, 2 n. 

Some Hadamard matrices are symmetric, that is: 

so that Equation (2) becomes: 

HH = n\ (3) 

Then in the inverse transformation 

the inverse Hadamard matrix H^' is given by: 
HHH-i=«H-i Using (3) 

1 
H-'=-H 

n 



and 



= -Hc 

n 



(4) 



So, for symmetric Hadamard matrices, the inverse trans- 
formation is the same as the forward transformation except 
that it includes division by the constant n. 

A particular set of symmetric Hadamard matrices, 
known as Walsh- Hadamard matrices, is formed by the direct 
products of the matrix H^ with itself, that is: 



H 



H^'^'(g)Hj2) 



where H^ 



1 
-1 



r= 1, 2, p 



and H p is the Walsh-Hadamard matrix of order (2P x 2P). 
The dfrect or Kronecker product operation, denoted ® , 
is defined for a {m x m) matrix A and a (v kv) matrix B as: 

A(X>B = 

B a^^B...a^B 



S,B a,,B...a,„B 



2 2 



««iB 



U2 



i...a B 

uu _1 



where A® B is a (mf x uv) matrix. So {« x n) Walsh- 
Hadamard matrices can be constructed where n = 2^ and p 
is a positive integer. The {8 x 8) Walsh-Hadamard matrix 
(p = 3) is shown in Table 1. 



TABLE 1 
Walsh-Hadamard Matrix of Order (8 x 8) 
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Equation (1) may be re-written as: 



/•= 1 



hijXj 



1, 2, 



(5) 



which shows Cj as a measure of the correlation between the 
input vector X and a discrete, two-valued function defined 
by the /th row of a Hadamard matrix. The functions 
formed by the rows of the Walsh-Hadamard matrix of 
order (n x n) are the set of Walsh functions of period n. 
Fig. 1 shows the set of Walsh functions of period 8 arranged 
in an order corresponding to the rows of the Walsh- 
Hadamard matrix. So, the vector of coefficients produced 
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Fig. 1 - The set of Walsh functions of period 8 
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by Walsh-Hadamard transformation describes the input 
data in terms of the amplitudes of a set of Walsh functions. 

Fourier analysis of Walsh functions reveals a linear 
relationship between the sequency of each Walsh function 
(the number of transitions between +1 and —1 in a period) 
and the frequency of the largest sinusoidal component of 
the Walsh function. For this reason, in the Walsh-Hadamard 
transform or sequency spectrum of a signal, the low- 
sequency components tend to represent low frequencies in 
the signal and the high-sequency components tend to repre- 
sent high frequencies in the signal. 

Other Hadamard matrices do not have this property. 
For example, the matrix shown in Table 2 is formed from 
cyclically shifted versions of a maximal-length pseudo- 
random sequence to which an extra row and an extra 
column of 1's have been added. 

TABLE 2 

Pseudo- Random Hadamard Transform Matrix 
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— 1 






— 1 
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— 1 




— 1 — 1 



Transformation with this matrix describes input data in 
terms of the amplitudes of the set of functions shown in 
Fig. 2. Individually, these functions show no regular 
structure, so it is difficult to interpret the transform coef- 
ficients as a spectrum. 

2,2. Transformation example 

Walsh-Hadamard transformation and inverse trans- 
formation will now be demonstrated using the portion of a 
television signal shown in Fig. 3. 

The digital signals to be transformed consist of a series 
of eight-digit binary numbers. These can represent 256 
discrete voltage levels in the corresponding analogue wave- 
form which will be labelled to 255 for convenience. The 
amplitudes of the signal of Fig. 3 at the marked sampling 
points are shown in Table 3. 

TABLE 3 

Values of the Samples Shown in Fig. 3 

Sample 12 3 4 5 6 7 8 

Amplitude 105 74 75 107 137 158 167 165 

These numbers represent a sampled-and-held and quantised 
version of the analogue signal, as shown in Fig. 4. 

For transformation, a set of n samples must be 
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Fig. 2 - A set of orthogonal functions of period 8 formed 
from a maximal-length pseudo-random sequence 
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Fig. 3 - A portion of a television waveform showing 
sampling poin ts 
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Fig. 4 - A sampled-and-held and quantised version of Fig. 5 - The sequency spectrum of tfie waveform of Fig. 4 
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arranged to form the vector X in Equation (1). The sim- 
plest arrangement is to use n consecutive signal samples 
as the elements X J to x^ of the input vector. So, the set of 
eight samples shown in Table 3 may be written as the 
vector: 



X= 105 

74 
75 
107 
137 
158 
167 
165. 



Multiplication of this vector by the {8 x 8) Walsh- 
Hadamard matrix involves the following set of operations 
and produces the vector of correlation coefficients shown: 



In the fast transform method, the input vector is multi- 
plied by a number of sparse matrices (matrices with a small 
number of non-zero elements), the product of which is the 
Walsh-Hadamard matrix: 



H 



^^^-1 



where each S is a (2P x 2P) matrix. Such a set of sparse 
matrices is formed by the following direct products: 



S, = H^ ® I ® 



H, ® 



I ®l® . 



(X) I 



H, 



105 + 74 -^ 75 -^ 107 + 137 + 158 + 167 + 165 
105 - 74 -t- 75 - 107 + 137 - 158 -1-167-165 
105-1- 74-75- 107 -i- 137 + 158- 167- 165 
105- 74-75+ 107 -i- 137- 158- 167 -i- 165 
105-1- 74-1- 75 H- 107- 137- 158- 167- 165 
105- 74-1-75- 107- 137 + 158- 167 -i- 165 
105 -1-74-75- 107- 137- 158+ 167 + 165 
105-74-75 + 107- 137 + 158+ 167- 165 



= 


988 




-20 




-40 




40 




-266 




18 




34 




86 



These operations are equivalent to multiplying the input 
signal by each of the Walsh functions shown in Fig. 1 and 
summing the resulting terms. Consequently, the sequencies 
to which the coefficients correspond are in the same order 
as the Walsh functions of Fig. 1. The sequency spectrum 
of the signal, shown in Fig. 5, is produced by arranging the 
coefficients in order of increasing sequency. 

To recover the signal vector, the vector of coefficients 
is multiplied by the Walsh-Hadamard matrix and divided by 
a scale factor. 



where I is the (2 x 2) unit matrix and H^ is the (2 x 2) 
Walsh-Hadamard matrix. For example, the (8 x 8) Walsh- 
Hadamard matrix can be expressed as a product of three 
sparse matrices Sj, S^ and S^ : 



H„ 



SsS.S, 



988 - 20 - 40 + 40 - 266 +18 + 34+86 
988 +20-40-40-266-18 + 34-86 
988 - 20 + 40 - 40 - 266 + 18-34-86 
988 + 20 + 40 + 40 - 266 -18-34 + 86 
988 -20-40+40 + 266-18-34-86 
988 + 20 - 40 - 40 + 266 + 18-34 + 86 
988- 20 + 40-40+ 266- 18 + 34 + 86 
988 + 20 + 40 + 40 + 266 +18+34-86 



= 


105 




74 




75 




107 




137 




158 




167 




J65j 



This inverse transformation in equivalent to an alge- 
braic summation of eight Walsh functions, with amplitudes 
given by the transform coefficients divided by 8. Fig. 6 
shows Walsh functions with amplitudes which are one- 
eighth the values given in the sequency spectrum (Fig. 5), 
and Fig. 7 shows the effect of progressively adding together 
the functions of Fig. 6 to reconstruct the signal. 

2.3. The fast transform algorithm 

By using a fast algorithm, the Walsh-Hadamard trans- 
form can be calculated more efficiently than by the direct 
matrix multiplication demonstrated in the previous section. 



where S, 



1 











1 











1 











1 











1 











1 











1 











1 











-1 











1 











-1 











1 











-1 











1 
















1 





-1 



(PH-144) 



- 5 



s = 



s = 



1 





1 




















1 





1 














1 





-1 




















1 





-1 


























1 





1 




















1 





1 














1 





-1 





_0 














1 





-1 


'1 


1 




















1 


-1 


























1 


1 




















1 


-1 


























1 


1 




















1 


-1 


























1 


1 




















1 


-1 



The transform is calculated inp stages, corresponding 
to the equations: 



mation. However, the nnost economical method of fast 
inverse transformation uses multiplication by the set of 
sparse matrices in the reverse order to that used for the 
forward transformation. This minimises the number of 
bits needed at each stage in the inverse transformation. 

For the fast inverse transformation, then, the Walsh- 
Hadamard matrix is expressed as the following product of 
the sparse matrices: 



H p - S S ■ . . Sf, 



2^ 1 2 

and the inverse transformation consists of the following 
products: 



b,=SpC 



b2=Vi^ 






^p-1 



Sp3p-i 



(6) 



where a^, a^. 



, ap_^ are vectors produced at inter- 
mediate stages in the transformation. At each stage, an n- 
dimensional vector is multiplied by an (« x n) sparse matrix. 
Each sparse matrix has only two non-zero elements in each 
row. In half the rows both non-zero elements are I's and, 
in the other half, one non-zero element is 1 and the other 
— 1, so each product of a vector and a matrix requires only 
V2n additions and Ym subtractions. There are p such pro- 
ducts in the transformation; therefore, the transform can 
be calculated in np = n\og^n operations. For the same order 
of matrix the direct multiplication method requires n — 1 
additions or subtractions to calculate each of the n coef- 
ficients, so the transform is calculated \n n{n — 1) opera- 
tions. For a transformation of order 8 the fast algorithm 
uses only 24 operations, instead of the 56 operations 
required for the method shown in the previous section. 



fc»p = S,bp_i 

where bj, b^, . . . , b„ represent the vectors produced at 
intermediate stages in the inverse transformation. Substi- 
tuting Equations (6) gives the following set of equations 
relating the vectors produced at intermediate stages in the 
forward and inverse transformations: 



'^1 "Sp^p^p-1 



^ ^-iSpSpSp_iap_2 



bp = S.S,...SpSpSp_i...S,x 



(7) 



Since 

Equations (7) become 



S^S^=2l 



r= 1, 2, . . . ,p 



2a 



'p-1 



2^ a 



'p-2 



In practice, the range of numbers which can be pro- 
duced at each stage is important, as this determines the 
number of binary processing elements needed to perform 
the transformation. The result formed by adding or sub- 
tracting two m-digit binary numbers contains »^ + 1 signifi- 
cant bits, so that the number of bits allocated in a fast trans- 
form processor must increase by one at each stage. There- 
fore, for a transformation of order 2P, if m bits are used to 
represent the range of possible values of the input signal, 
m + p bits must be used to represent the range of possible 
values of the transform coefficients. 

It has been shown in Equation (4) that the inverse 
transformation for symmetric Hadamard matrices involves 
the same matrix multiplication as the forward transfor- 



bp = 2Px 

Because the intermediate results are related by integer 
powers of two to intermediate results in the forward trans- 
formation, equal numbers of bits are required to describe 
the values in the inverse transformation to those required in 
the forward transformation. In general, the same number 
of bits are required in b^ as in ap_^, which requires 
m + p ~ r bits. However, equivalent bits are r bits higher 
in significance in the inverse transformation because of the 
scale factor 2''. This arises because the Hadamard matrix 
is not normalised (this is shown by the factors in Equation 
(2)). Therefore, bp, the value produced at the output of 
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forward transform 




-p stages- 
inverse transform 



Fig. 8 - Allocation of significant bits in a transform 
system (p = log^n) 

the inverse transformer, must be divided by 2^ to regain the 
exact value of X, the input vector. In binary arithmetic 
this scaling operation is accomplished simply by relabelling 
the binary digits with lower significance. 

The changes in the number of bits required at each 
stage of a transformation and inverse transformation of 
order n with an m-bit input are summarised in Fig. 8. For 
the inverse transformation two versions are compared: the 
continuous outline shows the number of bits needed to 
reconstruct the output of the forward transformation; 
the dashed outline shows the extra bits required for any 
combination of input values in the inverse transformation. 



so that words a fixed number apart in the signal can be 
added and subtracted. The sums are directed to the out- 
put, while the shift register, in its second use, delays the 
differences so that they can be fed to the output after the 
sums. Thus, the outputs are produced in an order con- 
sistent with the rows of the sparse matrix. 

The same arrangement can be used for all the stages 
of both forward and inverse transformers. The stages 
differ only in the length of their shift registers, the control 
of the data selectors, and the word-length. In general, to 
transform n words each of m bits requires p transformer 
stages where p = log^^. In the rth stage, the data selectors 
work with (m + r) bits, the adder and the subtractor each 
accept inputs of (m + r —'[) bits and produce outputs of 
(m + r) bits, and the shift register contains 2*^"''* words 
each of (m + r) bits. 

Therefore, transformations of larger blocks of data 
require approximately twice as many shift register elements 
with each unit increase in p. For large transformers (p>5), 
this approximately doubles the cost for each unit increase 
in p, so that distinct advantages must be gained from 
increases in the size of the transformation if the resulting 
large increases in cost are to be justified. 



3. Transform domain bit-rate reduction 



2.4. Practical Walsh-Hadamard transformers 

The sparse matrices of the fast algorithm define the 
set of operations required to perform the transformation. 
In each case, multiplication of a vector by a sparse matrix 
involves the addition and subtraction of elements spaced a 
fixed number of elements apart in the vector. With con- 
secutive signal samples used as the elements of the input 
vector, this operation corresponds to the addition to and 
subtraction from the signal of a delayed version of the 
signal. The arrangement of an adder, a subtractor, a shift 
register, and two data selectors shown in Fig. 9* will per- 



form these calculations." 



To transform blocks of 2^ 



samples, p such stages are required corresponding to the p 
Equations (6). 

In Fig. 9 the shift register is used in two ways. First 
it delays some of the words representing the input samples 

* Ttiis arrangement was devised by J. P. Ctiambers. 
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Fig. 9 - The rth stage of a Walshi-Hadamard transformer 



Any digital transformation which involves arithmetic 
operations inevitably produces a larger number of bits in 
the words describing the transform than were used in the 
input words. It has been shown that m + p bits are 
required to represent each coefficient of the Walsh- 
Hadamard transform precisely, where the input words con- 
tain m bits and the order of the transformation is n = 2P. 
It should be recognised, however, that this representation 
involves redundancy, since only 2"^" different sets of 
coefficients can be produced from the input words whereas 
2(m+p)n different sets of coefficients could be represented 
by n words each of (m + p) bits. 

With each increase in the order of the transformation, 
the number of bits needed to describe each coefficient of 
the transform increases by one. According to Parseval's 
theorem, energy is conserved in an orthonormal trans- 
formation. So, to equalise the amounts of energy repre- 
sented by the input signal and the transformed signal, the 
transform coefficients must be divided by the normalising 
factor ri''''. This represents a shift of significance of the 
binary digits of the coefficients downwards by % \oq^n 
bits. Therefore, half the increase in the number of bits is 
used to represent greater amounts of energy and the other 
half to represent smaller amounts of energy than can be 
described by one of the input words. In Fig. 10 the 
binary digits representing the coefficients for different 
sizes of transformation are depicted as boxes; digits 
representing equal amounts of energy are shown at the 
same horizontal level. The diagram shows that a consider- 
able reduction in the bit-rate of the transformed signal 
must be made even to achieve the bit-rate of the input 
signal. 
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F/gL ;0 - Relative significance of bits in ttie transform 
domain for different orders of transformation 

The bit-rate of the transformed signal may in practice 
be reduced without impairing signal quality by omitting the 
most significant bits of some of the coefficients. This is 
possible because, owing to bandwidth and amplitude 
limitations, television signals are not able to produce 
sufficient amplitudes of some Walsh functions to use the 
full range of values provided by the corresponding coef- 
ficients. However, the saving to be made by excluding 
only these signals is thought to be negligible. Thus, to 
make any worthwhile saving, a large number of legitimate 
but improbable television signals must be excluded. When 
savings of this type have been made, it becomes possible 
for a coefficient to exceed the range allocated to it. If this 
occurs, it causes an error which appears in the picture as a 
Walsh function, the amplitude of which is the difference 
between the actual value and the transmitted value of the 
coefficient. Consequently, the magnitude of the error can 
be minimised by sending the permissible value nearest to 
the actual value; in practice, this is achieved by limiting. 

Alone, this method is not sufficient to reduce the bit- 
rate of the transformed signal below that of the input 
signal. It can, however, be combined with other methods 
of bit saving. 

The omission of the least significant bits of the 
coefficients makes a further saving. This introduces 
quantising errors which produce in the picture an inter- 
ference signal formed by the combination of very low-level 
Walsh functions. Although such distortion is picture- 
dependent, it can be made to appear as noise. Once 
again, the errors can be minimised by sending the permis- 
sible value nearest to the actual value and this is achieved 
by rounding the coefficients to the level of the least 
significant bit transmitted. 



The number of least significant bits that can be 
omitted can be estimated by considering the amounts of 
energy represented by the bits before and after transfor- 
mation (Fig. 10). y^log^w bits of each coefficient represent 
amounts of energy smaller than that described by the least 
significant bit of the 8-bit p.cm. input signal. So omitting 
these bits in the transform domain will introduce into the 
output signal an average noise power approximately equi- 
valent to that due to 8-bit p.cm. quantisation. 

The least significant bits of the transform coefficients 
are not independent. Because of this it is possible to omit 
selected least-significant bits from the transform coefficients 
to a total of V^n log^n, and then to re-insert the correct 
values of these bits in the inverse transformation. This 
method gives no increase in noise level due to the truncation 
of the transform coefficients. The method is described in 
the Appendix. 

Other methods such as non-linear coding of coef- 
ficients and adaptive systems can be used to reduce the bit- 
rate of the transform further, but the processing involved 
in these methods is considerably more complicated. 

Non-linear coding reduces the bit-rate by eliminating 
some of the code-states describing high amplitude coef- 
ficients; if these states are produced in the transform, then 
the nearest permitted state is used instead. Thus, small 
amplitudes are transmitted accurately, while some large 
amplitudes are transmitted with a small error. To work 
successfully, the method requires that small amplitudes 
should occur much more frequently than large ampli- 
tudes. Table 4 demonstrates how a 4-bit code can be com- 
pressed to a 3-bit code for transmission and then expanded 
back to a 4-bit code with only small errors in some of the 
high values. 

TABLE 4 

An Example of a Non-Linear Quantising Law for Bit-Rate 
Reduction 



4-bit Compressed Expanded 


Error 


Code 


Code 


Code 


Magnitude 


0000 


000 


0000 


0000 


0001 


001 


0001 


0000 


0010 


010 


0010 


0000 


0011 
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0011 


0000 


0100 ) 
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0000 
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0100 
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r 101 \ 


[ 0110 


0001 


1000 




1001 
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1001 


110 


1001 


0000 
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1001 


0001 


1011 




1001 


0010 


1100 




1101 


0001 


1101 


111 


1101 


0000 


1110 


1101 


0001 


1111 




1101 


0010 
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Some adaptive systems attempt to exploit the pro- 
perty that several large values cannot occur together in a set 
of coefficients. This is because a single large coefficient 
may convey almost all the energy in a block of signal 
samples, and therefore, since energy is conserved in the 
normalised transformation, all other coefficients must be 
small. A number of adaptive systems have been considered 
in which a large number of bits are used to describe a coef- 
ficient only when that coefficient has a large value. The 
most significant bits of the remaining coefficients are then 
omitted. However, this saving is partly offset by extra 
bits needed to identify the large coefficients. Because of 
this, the overall saving is not likely to be large enough to 
justify the complexity of the processing equipment required. 

Several other methods of bit-rate reduction have been 
used successfully with the high-order transformations of 
pictorial data performed on digital computers. ^'^ In 
general, these methods cannot be applied to broadcast 
quality p.c.m. television signals because, at the data rate 
used, the processing equipment would be prohibitively 
expensive. 



4. A Walsh spectrum analyser 

4.1. Spectral analysis with Walsh functions 

The performance of the simpler methods of bit-rate 
reduction, in which some of the most and least significant 
bits of the coefficients are omitted, is readily predictable. 
The noise introduced by omitting a number of the least 
significant bits was estimated in the previous section, and 
the number of most significant bits that can be removed 
can be found by measuring the maximum values of the 
transform coefficients produced by television signals. 

Walsh-Hadamard transformation is equivalent to cor- 
relation of the signal with the set of Walsh functions 
(Equation (5)). To transform real-time television by 
direct correlation would require n correlators fed by a 
generator producing all of the set of n Walsh functions 
simultaneously. However, television signals may be trans- 
formed in slow time using a spectrum analyser consisting 
of a single correlator and a generator producing Walsh 
functions one at a time. The transform is then found by 
feeding the signal n times to the correlator, each time with 
a different Walsh function, to produce the n coefficients. 



Since only the distribution of amplitudes in the 
spectrum is required in the prediction of bit rates, it is not 
necessary to calculate all of the coefficients for each portion 
of signal. It is more convenient to correlate the signal 
directly with Walsh functions generated one after another. 
As each Walsh function is correlated with a different portion 
of the signal, the sets of coefficients produced do not con- 
stitute a full transformation of the signal. However, pro- 
vided the picture period is not simply related to the Walsh 
function period, over several picture periods every area of 
the picture will be analysed with every Walsh function. 
Therefore, for a still picture, all values of the coefficients 
which can be produced by that picture will be produced. 
Thus the maximum amplitude of each spectral coefficient 
is measured. 

The slow-time analysis method has the advantage that 
comparative measurements for different orders of trans- 
formation can be made merely by altering the period of 
the Walsh functions. Also, by suitably controlling the 
generator, the functions can be correlated with the signals 
corresponding to rectangular areas of the picture, so that the 
benefits of two-dimensional transformations may be asses- 
sed. The coefficients of any other Hadamard transfor- 
mation could similarly be found by replacing the Walsh 
function generator by a generator which produces the set of 
basis functions of the required transformation. 

The Walsh spectrum analyser thus consists of a Walsh 
function generator, a correlator and a maximum-value 
store. Digital arithmetic and storage are used, and a 
digital-to-analogue converter is used to allow the stored 
values to be displayed on an oscilloscope. A block diagram 
of the equipment is shown in Fig. 11. 

4.2. Walsh function generation 

Since the product of two Walsh functions is itself a 
Walsh function, it is possible to choose subsets of p func- 
tions which, when multiplied together, produce the com- 
plete set of 2^ functions. In general, multiplication of 
Walsh functions with sequencies i and / produces the 
function of sequency r©/, where © denotes modulo- 
two addition.* It is convenient to choose, as the functions 
of the subset, functions of sequency 1 (or as a binary 
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Fig. 12- Generation of a subset of Walsh functions 
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Fig. 13 - Waveforms in Fig. 12 

(a) Outputs of the binary counter 

(b) Outputs of the decoding gates 

(c) Outputs of the J— K bistables 



number 00 0001), 2 (00. . ._.0010), 4 (00 0100), 

8 (00 1000), , that is, f"'^ where r= 1, 2 p. 

Then, the functions to be multiplied together to form a 
particular function are indicated by the positions of '1's in 
the binary representation of the sequency. For example, 
to produce a Walsh function of sequency 13 (00. . . .1101) 

the functions with sequencies (00 1000), (00 0100) 

and (00. . . .0001) must be multiplied together. 

In logic circuits, the two values of Walsh functions, 
+ 1 and —1, can be represented conveniently by and 1 
respectively. Then the Walsh functions of the subset may 
be generated from a binary counter by decoding states in 
which a '0' is followed by less significant '1's and using 
these signals to change the states of J— K bistables. A 
circuit for generating a subset of four Walsh functions is 
shown in Fig. 12 and the waveforms generated are shown 
in Fig. 13. The waveforms in Fig. 13(c) comprise part of 
the required set of Walsh functions. With +1 and —1 
represented by and 1, multiplication is replaced by the 
exclusive-OR operation. Therefore, the other Walsh 

functions of the set can be produced by combining the 
functions of the subset in exclusive-OR gates. However, 
as only one function is required at a time for Walsh spectral 
analysis, the circuit of Fig. 14 may be used. This arrange- 
ment is particularly convenient because the boxed part of 
the circuit is known as a binary rate multiplier and a six-bit 
version is available as an integrated circuit* The sequency 
of the function to be generated is applied in binary form 
to the AND-gate inputs A, B, C and D to enable the state 
of the J-K bistable to be changed at the appropriate tran- 
sition points. Higher sequency functions may be generated 
by extending the binary counter and adding extra AND- 
gates. By driving the AND-gate inputs from a binary 
counter advanced by one at the end of each function, a 

* The use of this integrated circuit in Walsh function generation 
was suggested by J.P. Chambers. 
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Fig. 14- An alternative Walsti function generator 



complete set of Walsh functions may be generated, one 
after another with increasing sequency. 

This provides the basis of the Walsh function genera- 
tor used in the spectrum analyser. The 'sequency sweep' 
produced by the generator and fed to the correlator is 
analogous to the output of the swept-frequency oscillator 
used in Fourier spectrum analysers. 

4.3. Correlation using Walsh functions 

The correlation of two discrete functions is measured 
by summing the products of corresponding function values 
as shown in Equation (5). So, in general, a correlator con- 
sists of a multiplier to form the products, an adder to form 
the sums, and a store to hold intermediate values in the 
calculation. 

Correlation is much simpler when one of the functions 
is a Walsh function. Then, as the Walsh function value 
can be only -i-1 or —1, multiplication can change only the 
polarity of the corresponding value in the other function. 
When digital television signals are correlated with Walsh 
functions, the 8-bit codewords representing the signal 
samples are passed unchanged to the adder if the corres- 
ponding Walsh function value is +1. If the Walsh function 
value is —1, then negative numbers having the same magni- 
tude as the signal samples are passed to the adder. 

The correlator in the Walsh spectrum analyser uses 



two's complement notation to represent negative numbers. 
The two's complement of a binary number is formed by 
complementing each digit of the number and adding one 
to the resulting word. Hence, the binary code is continued 
below zero with numbers as follows: 
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0. 


. .010 


1 


0. 


. . 001 





0. 


.. 000 


1 


1 . 


.. Ill 


2 


1 . 


.. 110 


3 


1 . 


. . 101 


4 


1 . 


.. 100 



This representation allows both positive and negative 
numbers to be added together using an ordinary binary 
adder. 

After multiplication, the codewords describing the 
products with each Walsh function are summed in the 
accumulator (Fig. 15). This consists of an adder, the out- 
put of which is fed to a store. The output of the store is 
fed to one input of the adder and the products are fed to 
the other input. Each product is added to the sum of all 
the previous products and the result stored. When all the 
products corresponding to one Walsh function have been 
added together, the result is a transform coefficient. 
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Fig. 15 - The correlator used in t/ie Walshi spectrum 
analyser 

Because the transform coefficients can have a larger dynamic 
range than the input samples, 16-bit arithmetic is used in 
the correlator. This allows the coefficients of transfor- 
mations of up to 256 8-bit words to be calculated. 

4.4. Displays of sequency spectra 

The sequency spectra measured by the analyser can 
be shown in several different ways depending on how the 
sequency coefficients are processed before digital-to-ana- 
logue conversion. If the output of the correlator is con- 
verted directly to an analogue signal and fed to an oscillo- 
scope, the coefficients are shown in sign and magnitude 
form to produce a display similar to Fig. 5. Also the sign 
may be suppressed to produce a display of magnitude 
against sequency. 

The most important feature to be determined is the 
largest magnitude that each sequency coefficient attains, 
since this fixes the upper limit of the coding range for each 
coefficient and so determines the required bit-rate for linear 
coding. To facilitate the measurement of the maximum 
values, two other' processing operations can be included 
before digital-to-analogue conversion. The first of these 
uses a comparator and a register to store the largest ampli- 
tude of each coefficient. Then the contents of the storage 
register can be displayed as a spectrum of maximum ampli- 
tudes. The second operation consists of finding the 
position of the most significant 'V in the binary number 
used to represent each amplitude. The position of the 
most significant 'V can be represented by a three-bit code, 
which, after conversion to analogue form, produces an 
eight-level signal. When displayed on an oscilloscope, this 
signal clearly identifies the magnitude of the most signifi- 
cant bit 'used by each coefficient; thus the number of 
unused bits may be found. 



5. Sequency spectra of television signals 

5.1. Factors affecting the spectra 

The purpose of an orthogonal transformation in bit- 
rate reduction is to redistribute the energy of the signal 
between the transform coefficients. Then, if the distri- 
bution is favourable, the set of transform coefficients may 
be represented by fewer bits than the original signal. How- 
ever, the way in which the energy is distributed depends not 
only on the transformation, but also on the sampling of the 
analogue signal and the way in which the samples are 
grouped together before transformation. The extent to 



which these factors may be manipulated to produce more 
favourable energy distributions will be described by examin- 
ing the sequency spectra of a number of transformation 
systems. 

First, Walsh-Hadamard transformation of 32 samples 
taken sequentially (as in Section 2.2) will be considered 
with a sampling frequency (f^) of 13-296875 MHz. This 
frequency, a multiple of line frequency which is near to 
three-times the colour subcarrier frequency, ensures that all 
possible values of the spectral coefficients are measured. 
The spectrum obtained with this transformation system 
will be used to demonstrate the effect of changes in picture 
content. Subsequently, the effects of different sampling 
frequencies, different sample groupings and a different 
transformation will be described. Fortunately, the effects 
of these changes are generally independent of each other, 
so that they may be described separately. 

For all the measurements, the analogue-to-digital 
converter was adjusted so that a 100% colour-bars signal 
just filled the conversion range. 

5.2. The spectra of video signals 

It was shown in Section 2.3 that m + log^n bits were 
required to represent each coefficient of the transform of 
n m-bit numbers. However, because the analogue video 
signal is limited in bandwidth to 5-5 MHz and in amplitude 
to 0-7V between black-level and white-level, the p.c.m. 
video signal cannot produce all combinations of n 8-bit 
numbers. In fact, some of the coefficients produced by 
transforming video signals can be represented accurately 
with fewer than 8 -i- log^M bits. 

The maximum possible value of each coefficient is 
produced when the video signal takes the form of an 
appropriately phased Walsh function corresponding to that 
coefficient with a magnitude of 0-7V peak-to-peak and 
limited in bandwidth to 5-5 MHz. For Walsh-Hadamard 
transformation of thirty-two samples, grouped sequentially 
and with a sampling frequency of 13-296875 MHz, the 
sequency spectrum of maximum possible values is shown in 
Fig. 16. The low-pass filtering has little effect on the low- 
sequency Walsh functions, whereas the amplitudes of the 
high-sequency functions are reduced considerably. The 
number of bits which are never used are shown in row A of 
Table 5. Although a total of 26 bits can be removed, this 
is much less than the VMoq^n (in this case, 80) extra most 
significant bits which have to be added during the trans- 
formation. Consequently, to be able to transmit all 
possible television signals without any loss of accuracy, more 
bits must be used to describe the transform coefficients 
than were used to describe the original signal. 

The amplitude limitation of 0-7V applies only to 
luminance signals and the coded colour signal can exceed 
this value. For example, the waveform representing 

saturated red has a peak-to-peak magnitude of 0-885V. 
The spectrum of this waveform is shown in Fig. 17. 
Although the amplitude of the signal waveform is greater 
than 0-7V, with this sampling frequency the transform 
coefficients are all smaller than those of Fig. 16. This is 
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The sequency spectrum of a 0-885Vp_p colour 
subcarrier waveform 
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Fig. 18 - The sequency spectrum of a television signal 

representing white alphanumeric characters on a 

black background 



Fig. 19 - The sequency spectrum of a 100% colour 
bar waveform 



■ In this Figure and in Figs. 17, 18, 19, 20, 21, 23, 24, 26, 27, 29. 30, 33, 35, 38 and 39, the term sequency spectrum is used to describe a 
graph showing the largest magnitudes of the transform coefficients plotted against sequency. The graphs have been produced for signals rep- 
resenting still pictures by measuring the coefficients over many picture periods and retaining the largest value for each sequency. The 
polarities of the individual coefficients are ignored for these graphs, but could be positive or negative for all coefficients except the zero- 
sequency or average-level coefficient, which is always positive. The ordinate scales used are the same for graphs relating to the same trans- 
formation block size («). For different block sizes the scales are related in the ratio of the block sizes; so, for example, magnitudes that 
appear as the same size in graphs for « = 32 and n = 64 are, in absolute terms, twice as large in the graph for n = 64. 

These points also apply to the graphs shown in Figs. 42 and 43, although, because of the different transformation used, the abscissa is 
no longer a measure of sequency, but relates to the phasing of the pseudo-random sequence. 

TABLES 

The Numbers of Unused Most Significant Bits of Each Coefficient for the Spectra of Figs. 16, 18 and 19 



Sequency 01 23456789 
A 0000 00000 
B 111111111 
C 0011222232 
D 11111111 



10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 Total 
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because the energy of the sinusoidal subcarrier waveform is 
split between a nunnber of coefficients. 

In practice, the spectrum approaches the theoretical 
limits of Fig. 16 most closely for signals containing large 
numbers of fast transitions between black-level and white- 
level, and for signals containing high amplitudes of colour 
subcarrier. For example. Fig. 18 shows the sequency spec- 
trum of a video signal representing a large number of white 
alphanumeric characters arranged in a regular format against 
a black background. Fig. 19 shows the sequency spectrum 
of the 100% colour bar waveform. In general, the coef- 
ficients in the lower half of the sequency spectrum are 
larger in Fig. 18 than in Fig. 19, whereas the coefficients in 
the high-sequency half of the spectrum are larger in Fig. 19. 
By combining the results for these two signals, taking the 
larger value for each coefficient in each case, a spectrum is 
produced which is very seldom exceeded by television 
signals. The number of bits in each coefficient which are 
not used in these two signals are shown in Table 5; row B is 
for alphanumeric characters only, row C is for colour bars 
only, and row D is for the two signals together. It is con- 
venient to use this combined spectrum as the basis for 
comparison of different systems, since this spectrum is 
representative of the most difficult that a bit-rate reduction 
system for normal broadcast television signals will meet. 

Picture material which does not contain fast transitions 
between black and white, and which is not highly coloured 
produces a spectrum in which many coefficients are several 
times smaller than those of Figs. 18 and 19. 

5.3. The effect of changes in the order of the trans- 
formation 

The order of the transformation, denoted by «, the 
number of samples transformed, is an important variable. 
It is reasonable to expect that increasing n may lead to 
larger bit-rate reductions as this will allow the transfor- 
mation to make use of the correlation between more widely- 
spaced samples. To what extent this is true for television 
signals can be found by examining the sequency spectra 
for different values of n. 
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5.4. The effect of changes in sampling frequency 

The sampling frequency used in the transformation 
system acts as a scaling factor between frequencies in the 
signal and the sequencies of the functions represented by 
the coefficients. The highest-sequency coefficient repre- 
sents the amplitude of the half-sampling frequency com- 
ponent in the signal. Therefore, as the sampling frequency 
is reduced, both the highest-sequency coefficient and all 
the other coefficients carry information corresponding to 
lower frequencies in the signal. Since, in monochrome 
signals, the lower frequencies are usually present with higher 
amplitudes, lowering the sampling frequency tends to cause 
a small increase in the average number of bits required for 
each coefficient. Conversely, increasing the sampling 
frequency reduces slightly the average number of bits per 
coefficient. 



Sequency spectra for transformations of order 2^ to 
2* samples taken sequentially are shown for alphanumeric 
character signals in Fig. 20 and for 100% colour bar signals 
in Fig. 21. For each signal, the shapes of the spectra are 
similar for all transform sizes. The higher resolution of the 
larger transformations reveals more detail in the structure 
of the spectra. The diagrams show that the coefficients 
decrease in amplitude relative to the zero-sequency coef- 
ficient as the transformation order increases. 

To assess the bit-rate required for each value of «, the 
average number of unused most significant bits is subtracted 
from the 8 + Vilog^n bits per coefficient required in theory. 
Fig. 22 shows the average number of bits per coefficient as 
a function of the order of the transformation (n) for a 
number of different signals. The graphs suggest that large 
transformations do not necessarily lead to a reduction in 
bit-rate since the range of coefficients with significant 
amplitudes tends to increase with n. 



When signals containing large amplitudes of colour 
subcarrier are considered, the effect of changes in sampling 
frequency become more important. This is because parti- 
cular sampling frequencies concentrate the colour infor- 
mation into some transform coefficients. This occurs when 
there are whole numbers of cycles of the colour subcarrier 
in each block of samples for transformation. For a block 
of n samples, this happens when the sampling frequency is 
"/n^ times the subcarrier frequency, where n^ is an integer 
representing the number of cycles of subcarrier in the block. 
The sequency spectra of a subcarrier-frequency sine wave of 
0-885V peak-to-peak magnitude are shown in Fig. 23 for 
« = 32 and «j. = 10, 11, . . . ., 16. None of these values 
produces a block rate having a simple relationship to line 
frequency. Over this range, as the sampling frequency is 
reduced, the sequency of the largest coefficient (excluding 
the zero-sequency coefficient) increases. Also, if n^ has 
factors in common with n, the number of coefficients 
which respond to subcarrier signals is reduced. 
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Fig. 23 - Sequency spectra of a 0-885 V colour sub- 
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Fig. 24- Sequency spectra of a 100% colour bar waveform at sampling frequencies which concentrate 

the colour signal energy (n = 32) 



When the subcarrier is modulated by colour changes, 
sidebands are produced around the sequencies correspond- 
ing to subcarrier frequency. This is demonstrated by the 
sequency spectra of 100% colour bars which are shown in 

Fig. 24 for « = 32 and n^ = ^Q, 11 , 16. For n^ = 

13 to 16 the sampling frequencies are below the Nyquist 
rate for a 5-5 MHz bandwidth signal. 

The average number of bits required to represent each 
coefficient is shown in Fig. 25 for sampling frequencies 
ranging from twice the colour subcarrier frequency (2/sc) 
to over three-times the colour subcarrier frequency (S/j,.). 
The measurements were made at frequencies for which n^ 
is an integer. For the colour bar signal, the graph shows a 
small advantage in using sampling frequencies such as 2/5^ 
and (8/3)/5(, (n^ = 12) which concentrate the energy of the 
subcarrier into a small number of components. For other 
signals, a reduction in sampling frequency leads to a small 
increase in the number of bits per coefficient, as expected. 



When both types of signal are considered together, there is 
a slight increase in the number of bits per coefficient as the 
sampling frequency is reduced. 

Larger values of n reveal more closely the structure 
of the sidebands caused by modulation of the subcarrier. 
Fig. 26 shows the spectra of 100% colour bars for a trans- 
formation of order 256 with sampling frequencies of 2/"sc 
and (8/3)/s(, in comparison with that for 3/5^,. Further, 
Fig. 27 shows the spectra for alphanumeric characters with 
n = 256 at the same sampling rates. This demonstrates the 
slight shift of energy to higher sequencies as the sampling 
frequency is reduced. 

Changes in sampling frequency do not produce marked 
changes in the sequency spectra of signals containing only 
luminance information until block-lengths of more than one 
television line are used. This is because until then, in 
general, there is no periodic structure in the waveform 
which can correspond strongly to particular Walsh functions. 
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Fig. 24 - Sequency spectra of a 100% colour bar waveform 

at sampling frequencies which concentrate the colour 

signal energy (n = 32) 
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Fig. 25 - The variation of the average number of bits 
required to represent the coefficients at sampling fre- 
quencies which concentrate colour signals into a reduced 
number of coefficients (n = 32) 



5.5, A method of concentrating colour signals by sub- 
sampling* 

If the sampling frequency is an integer multiple of 
the colour subcarrier frequency, then it is possible to 
concentrate the colour information into the low-sequency 
transform coefficients by re-grouping the samples before 
transformation. For a sampling frequency of ^-times 
subcarrier frequency (where A is an integer) the method 
consists of forming A groups each containing n regularly 
spaced samples taken at subcarrier-frequency rate. There- 
fore, in a section of the waveform representing an area of 
constant colour, all n samples in a group will be equal. 
When these groups of n samples are transformed, all the 
energy of the signal will be contained in the zero-sequency 
coefficients and the amplitudes of all other coefficients will 
be zero. When the subcarrier signal is modulated by colour 
changes, the associated sidebands are carried as low- 
sequency coefficients. 



' This method was suggested by Dr. G.J. Phillips. 
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Fig. 26 - Sequency spectra of a 100% colour bar waveform 
witfi sampling at 2f^^, (8/3) f^^ and 3f^^ (n = 256) 



With this method, the majority of the energy from 
both luminance and chrominance signals is concentrated 
into the low-sequency coefficients. This can be shown by 
considering the frequency spectra of the sub-sampled blocks 
of signal. Fig. 28 shows the frequency spectrum of a video 
signal sampled at subcarrier rate compared with that for 
three-times subcarrier sampling. The baseband part of the 
sub-sampled signal, that is the portion between and half- 
sampling frequency (in this case, half-subcarrier frequency), 
is shown at {d) in Fig. 28. It can be considered to contain 
part of the upper sideband of the baseband signal, part of 
the lower sideband of the signal centred on/^^, and part of 
the lower sideband of the signal centred on —f^^.. Alter- 
natively, it can be considered as a version of the video 
spectrum before sampling, folded back on itself at sub- 
carrier frequency, and then folded back again at half- 
subcarrier frequency. When the sub-sampled signals are 
transformed, the low frequencies in the baseband spectrum 
of the sub-sampled signal (Fig. 2Q(d)) produce large ampli- 
tudes of the low-sequency coefficients, and the high 
frequencies produce large amplitudes of the high-sequency 
coefficients. Therefore, it is possible to identify the 
sequency coefficients into which most of the energy 
associated with frequencies in the video signal spectrum 



are 



to (3/2)/,, 

both low 



(Fig. 28(a)) are transformed. Frequencies from to V^f^^ 
are converted to the coefficients of sequency to n — 1, 
frequencies from V4^^ to f^^ are converted to sequencies 
from n — 1 to 0, and frequencies from f^_ 
converted to sequencies to « — 1. Therefore 
frequencies and frequencies near to subcarrier frequency 
are carried by the low-sequency coefficients of the trans- 
form. 

The method is very effective with colour signals. 
For example, the sequency spectrum of 100% colour bars 
transformed after re-grouping, shown in Fig. 29, has very 
little energy in the high-sequency coefficients compared 
with the spectrum for colour bars without re-grouping 
shown in Fig. 19. However, the spectrum of the alpha- 
numeric characters signal is most adversely affected by re- 
grouping (compare Fig. 30 with Fig. 18). This is because 
components having relatively low frequencies, but high 
amplitudes, are converted to high-sequency coefficients. 
The bit-rates required for these signals are shown in Fig. 31 
for several values of n. Comparing the results for the com- 
bined spectrum of colour bars and alphanumeric characters 
in Fig. 31 with those in Fig. 22 shows that the numbers of 
bits needed for these signals are consistently higher when 
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Fig. 27 - Sequency spectra of the alphanumeric characters 
signal with sampling at2f^^, (8/3jf^^ and 3f^^ (n = 256) 



sub-sampling is used. (This situation is, however, reversed 
when non-linear quantisation is employed in the Hadamard 
domain. ■^) 

5.6. Two-dimensional transformations 

Walsh- Hadamard transformation is more effective 
when samples close together in the signal are similar in 
value, because the amplitudesof high-sequency coefficients 
are then small. Since video signals are produced by scanning 
a two-dimensional picture, samples obtained from neigh- 
bouring picture points are generally similar in value. So 
there is a similarity between samples in the video signal one 
line period apart, as well as between adjacent samples on 
the same line. 

This similarity can be exploited by grouping together, 
for transformation, sets of samples which correspond to 
rectangular areas of the picture. If the number of signal 
samples in the height and width of each area are both integer 
powers of two, then the spaces between the scanning lines 
correspond to transitions in the Walsh functions. It is 
possible then to describe the Walsh functions in terms of 
horizontal and vertical sequencies which, to a first approxi- 
mation, correspond to horizontal and vertical spatial fre- 



quencies in the picture. The set of Walsh functions of 
order 16 are shown in Fig. 32 as two-dimensional (4 x 4) 
functions identified by components of horizontal and 
vertical sequency. So, for example, when a two-dimen- 
sional transformation is used with signals which do not 
change from line to line, all coefficients of non-zero vertical 
sequency have zero amplitude. In general, the majority 
of the energy in a television signal is carried by coefficients 
having low horizontal or vertical sequency. 

A two-dimensional transformation may be performed 
by first transforming sets of samples in each line and then 
transforming the sequency coefficients thus obtained to 
produce the two-dimensional coefficients. Alternatively, 
it is possible to derive the sets of two-dimensional coef- 
ficients using an ordinary one-dimensional transformation 
by re-grouping the samples from each area of the picture 
before transformation. In practice, the latter method is 
preferable because most of the storage required is for 8-bit 
television samples, whereas in the former method most of 
the storage is for transform coefficients which have a greater 
dynamic range. 

The order of the re-grouped samples is that which 
would be obtained by a sequential scan of the original 
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Fig. 28 - A comparison of tlie frequency spectra produced 
by sampling at three-times subcarrier rate (f^ 
sampling at subcarrier rate (f^ 



(a) The baseband spectrum 






3f^^j with 



(^)^s = ^sc 



[d) The effective baseband spectrum for f = f 
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Fig. 29 - The sequency spectrum of a 100% colour bar 
waveform transformed after sub-sampling at subcarrier rate 

area of picture; that is, samples from the first line are taken 
in order, followed by samples from the second line taken 
in order, and so on. 

When the re-grouped samples have been transformed 
they are nominally described in terms of the coefficients of 
a one-dimensional transformation. Therefore, it is necessary 
to know the relationship between the sequency of the one- 



Fig. 30 - The sequency spectrum of the alphanumeric 

characters signal transformed after sub-sampling at 

subcarrier rate 
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Fig. 31 - Transformation of groups of sub-sampled signals: 
the variation of bit- rate with transformation order 

dimensional Walsh functions and the horizontal and vertical 
sequencies used to describe two-dimensional functions. 
This can be found by investigating the scanned versions of 
the two-dimensional Walsh functions. For a block of 2^ 
samples, composed of 2" samples horizontally and 2 
samples vertically so that p = u + v, the one-dimensional 
sequency can be expressed as a binary number, the digits of 

which are s -,, Sp_2, , s^, s^. Then the horizontal 

sequency of the corresponding two-dimensional function is 
the binary number made up of the digits s„_i, Sp__2- ■ ■ ■ ■■ 
Sp-v Further, the vertical sequency of the two-dimen- 
sional function is the binary number made up of the digits 



u-2' 
if s. 



'o if 'p 



= and s„ 



= 1 (s represents the complement of s). 
Applying this to Fig. 32, it is found that going through the 
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functions with S^ = with increasing Sy followed by the 
functions with S^^ = 1 with decreasing S'y followed by the 
-functions with 5^ = 2 with increasing S^ followed by the 
functions with S^ = 3 with decreasing 5^ is equivalent to 
going through the one-dimensional sequencies from to 15. 
This allows the one-dimensional sequency spectra of re- 
grouped samples to be interpreted in terms of two- 
dimensional sequencies. 

The one-dimensional spectra of the alphanumeric 
characters signal are shown in Fig. 33 for two-dimensional 
blocks of 32 samples. In general, the coefficients become 
smaller as the horizontal and vertical sequencies increase. 
This is demonstrated more clearly by Fig. 34 which shows 
the relative numbers of bits required for each coefficient 
arranged in terms of horizontal and vertical sequency. The 
models show that the amplitudes of the coefficients 
decrease more rapidly with increases in horizontal sequency 
than with increases in vertical sequency. This is because on 
the picture the distance between adjacent lines in the same 
field is almost twice the distance between adjacent samples 
on the same line. So, as the vertical samples are more 
widely separated, they are less likely to be similar in value. 

The one-dimensional spectra of colour bars are shown 
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Fig. 33 - Sequency spectra of two-dimensional transforms of the alphanumeric characters signal (f = 13-296875 MHz, n = 32 j 
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Fig. 34 

Sequency spectra for the alphanumeric characters signal showing the profiles of the most significant bits required for the 

coefficients in terms of horizontal and vertical sequency (f^ = 13-296875 MHz, n = 32). The diagrams demonstrate only 

the number of most significant bits that may be omitted from the coefficients and should not be interpreted 

as indicating the number of bits required for each coefficien t 
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Fig. 35- Sequency spectra of two-dimensional transforms of a 100% colour bar waveform (f^ = 13-296875 MHz, n - 32) 
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Fig. 36 - Sequency spectra for a 
100% colour bar waveform show- 
ing thie profiles of the most sig- 
nificant bits required for the 
coefficients arranged in terms of 
horizontal and vertical sequency 
(f^ = 13-296875 MHz, n = 32). 
The diagrams demonstrate only 
the number of most sign if lean t 
bits that may be omitted from 
the coefficients and should not 
be interpreted as indicating the 
number of bits required for each 
coefficient 
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The effect on the bit-rate of changes in the shape of 
the area of picture transformed is dependent on the signal 
material. The graphs of bit-rate against block shape for 
n = 32 and 64 (Fig. 37) show that while square blocks 
slightly reduce the bit-rate for alphanumeric characters, 
square blocks may slightly increase the bit-rate for colour 
bars. When the spectra for the two signals together are 
considered, there is little advantage in any particular shape. 

For larger values of n, the spectra have similar 
characteristics but more detail can be seen. For example. 
Figs. 38 and 39 show spectra for blocks of 256 samples. 
The spectra for blocks of 1 6 x 1 6 samples are shown arranged 
in terms of horizontal and vertical sequency in Figs. 40 and 
41. In Fig. 40 the peak at S'y = 7 and 8 and S^ =9, 10, 
11, 12 and 13 was produced by the colour synchronising 
burst on the back-porch of the television waveform. 

5.7. Pseudo-random Hadamard transformation 

For some values of n several different Hadamard 
transformations are possible. For bit-rate reduction, the 
Walsh-Hadamard transformation is of most interest because 
of the correspondence between sequency and frequency. 
However, another Hadamard transformation with contrast- 
ing special properties uses the pseudo-random derived 
matrices mentioned in Section 2.1. 



Fig. 37 - Graphs of the average number of bits/coefficient 

against block shape for two-dimensional transformations. 

Dashed lines are for n = 32 and continuous lines are 

forn = 64 



in Fig. 35 for two-dimensional blocks of 32 samples. 
These spectra show large coefficients at sequencies corres- 
ponding to one-quarter of sampling frequency in the 
vertical direction. This is caused by the offset of approxi- 
mately one-quarter of a cycle between subcarrier waveforms 
on adjacent lines of the same field. The peak produced by 
the subcarrier is visible in the models of Fig. 36. 



The basis functions for this transformation are formed 
using cyclically-shifted versions of a pseudo-random se- 
quence. Therefore, the functions have no distinguishing 
feature such as sequency which may be used to classify 
them. Also since any phase of a signal is equally possible 
in the television waveform, it is reasonable to expect this 
transformation to spread the signal energy evenly between 
all the functions except for that which describes the 
average signal level. 

One-dimensional pseudo-random transform spectra 
with n = 32 for alphanumeric characters and colour bar 
signals are shown in Fig. 42. Apart from the coefficient 
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Fig. 38- Sequency spectra of two-dimensional transforms of tiie alpfianumeric cfiaracters signal (f^= 13-296875 MHz, n =256) 
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Fig. 39 - Sequency spectra of two-dimensional transforms of a 100% colour bar waveform (f = 13-296875 MHz, n = 256} 





Fig. 40 - The sequency spectrum of the alphanumeric 
characters signal showing profiles of the most significant 
bits required for the coefficients arranged in terms of 
horizontal and vertical sequency (f^ = 13 296875 MHz, 
n = 256). The diagrams demonstrate only the number of 
most significant bits that may be omitted from the coef- 
ficients and should not be interpreted as indicating the 
number of bits required for each coefficient 



Fig. 41 - The sequency spectrum of a 100% colour bar 
waveform showing profiles of the most significant bits 
required for the coefficients arranged in terms of horizontal 
and vertical sequency (f^ = 13-296875 MHz, n = 256). 
The diagrams demonstrate only the number of most signifi- 
cant bits that may be omitted from the coefficients and 
should not be interpreted as indicating the number of bits 
required for each coefficient 
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Fig. 42 - Spectra for the pseudo-random Hadamard transformation (f = 13-296875 MHz, n = 32) 
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Fig. 43 - Spectrum of a 1(X)% colour bar waveform for 

the pseudo-random Hadamard transformation (f^ = 

13-296875 IMHz, n = 256) 



Fig. 44 - The variation of the average number of bits/ 
coefficient with the transformation order for the pseudo- 
random Hadamard transformation 



describing the average level, all the maximum amplitudes 
are within a 2:1 range of each other. The spectra for the 
two different signals are much more similar than the equiva- 
lent spectra for Walsh-Hadamard transformation. Increasing 
the order of the transformation makes the coefficients 
smaller relative to that describing the average level of the 
signal. Fig. 43 shows the pseudo-random Hadamard 

spectrum of order 256 for a 100% colour bar signal. 

The average number of bits required to represent 
each coefficient in the pseudo-random Hadamard transform 
is shown as a function of « in Fig. 44. The number of bits 
required are generally higher than in the equivalent Walsh- 
Hadamard transformation (Fig. 22). The low results for 
« = 32 have occurred because, with this size of transfor- 
mation, many of the coefficients reached almost to the top 
of the range of a bit. This effect is less noticeable in the 
results for Walsh-Hadamard transformation because there is 
a much wider spread of coefficient values. 



6. Discussion of results 

In the preceding sections, it was first shown that con- 
siderably more bits are required to represent the transform 
coefficients than are required to represent the original 
samples. Then methods of omitting some of the least 
significant bits were presented which remove halt of this 
increase. In Section 5, it was shown that a further 
reduction could be made frorn the most significant bits 
using several different transformation arrangements. How- 
ever, in spite of these reductions, if a wide range of signals 
is to be reproduced accurately, then the bit rate required 
for the transform is still greater than the original bit rate. 
Therefore, the transformation itself does not lead directly 
to a reduction of the bit rate, but must be combined with 
non-linear or adaptive coding methods if any reduction is 
to be achieved 
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It is appropriate here to examine in more detail the 
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purpose of transformation in bit-rate reduction. The 
redundancy in the signal arises because the brightness of a 
point in the picture is usually closely related to the bright- 
ness of the surrounding areas. To expose this redundancy, 
the relationships between the values of nearby samples 
should be described, rather than the sample values them- 
selves. This can be done by transforming the signal in 
blocks in such a way that the signal is represented by the 
amplitudes of a set of basis functions. The use of ortho- 
gonal basis functions ensures that no part of the signal 
energy is carried twice by the transform. 

The effectiveness of a transformation can be judged 
by the way in which the signal energy is split between the 
transform coefficients. A transformation performs well if 
most of the energy from commonly occurring signals is con- 
centrated into a small number of coefficients. These 
important coefficients can then be coded accurately. The 
remaining coefficients will have small values for commonly 
occurring signals, but, to deal with more unusual signals, 
the capacity must be provided for occasional, large values. 
This can be done using relatively few bits by non-linearly 
quantising the coefficients. 

Walsh- Hadamard transformation concentrates most of 
the energy of commonly occurring luminance signals into 
the low-sequency coefficients. The zero-sequency coef- 
ficient is always very large, whereas the other low-sequency 
coefficients can vary between large and small values. The 
distribution of these values is strongly dependent on the 
number and the amplitude of edges in the picture. Lumi- 
nance signals rarely produce large high-sequency coefficients. 

However, with sampling frequencies near to three- 
times the colour subcarrier frequency, the energy of colour 
signals is spread throughout the medium- and high-sequency 
coefficients. For signals representing areas of constant 
colour, the amplitudes of the coefficients are approximately 
uniformly distributed between zero and the maximum 
value, with a small bias towards the large values. 

So, whereas the Walsh- Hadamard transform of mono- 
chrome television signals is conditioned reasonably well for 
bit-rate reduction, the transform of PAL-encoded colour 
signals, sampled at three-times subcarrier frequency, is not 
so suitable. 

Although none of the transformation systems des- 
cribed in Section 5 leads directly to a reduction in bit-rate, 
some of the systems do improve the distribution of the 
signal energy between the coefficients. Thus they may 
allow worthwhile reductions to_ be made by non-linear 
quantisation or adaptive coding. 
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The greatest improvement can be made by using a 
sampling frequency of 2/sc* °'' (S/SI/jj,, since this concen- 
trates the colour signal energy into a small number of coef- 
ficients as well as reducing the word rate. However, 
reducing the sampling frequency will cause the high- 
sequency coefficients produced by luminance signals to be 
slightly increased. 

* This is possible if a method of sub-Nyquist sampling is used. 



Transformation of two-dimensional blocks concen- 
trates luminance signals into the low horizontal and vertical 
sequencies and colour signals into the mid-vertical se- 
quencies. 

There is less benefit in the other arrangements tried in 
Section 5. It is reasonable to expect that increasing the 
transformation order would reduce the occurrence of 
large values in most coefficients, but, beyond one-dimen- 
sionai transformations of 32 or 64 samples, such reductions 
would be unlikely to be sufficient to justify the increases in 
cost. Further, the sub-sampling arrangement described in 
Section 5.5 is beneficial for colour signals, but detrimental 
for luminance signals because of the much wider spacing of 
the samples to be transformed. On balance, this method 
would produce an improvement because large amplitude 
coefficients occur less frequently, and there is therefore 
better scope for non-linear coding. 

In the pseudo-random Hadamard transformation, the 
signal energy is widely spread between the coefficients and 
the distribution of amplitudes within each coefficient is not 
favourable for non-linear quantisation. Moreover, no fast 
algorithm is known for this transformation. 

This suggests that a system which combines 7f^^ 
sampling with two-dimensional Walsh- Hadamard transfor- 
mation would have most potential for bit-rate reduction. 
The sub-Nyquist sampling method does, however, bring 
some penalties in picture quality, which might rule out 
its use in high-quality transmission. In this case, the use of 
(S/Sl/gc sampling, which is less effective at concentrating the 
colour but could work satisfactorily with sharp cut-off 
filters, would remain as the best alternative. Otherwise, 
for three-times subcarrier sampling, the sub-sampling method 
works well except in areas containing large--amplitude 
luminance transitions. This method could be combined 
with two-dimensional transformation, in which case the 
spectrum would take on the characteristics of both the 
spectra for the sub-sampled transformation and the two- 
dimensional transformation. The colour signal energy 
would be concentrated into the coefficients with low 
horizontal and middle vertical sequencies, whilst the lumi- 
nance signal energy would appear mostly in the coefficients 
with low horizontal or vertical sequency. Luminance 
signals would produce larger amplitudes in the higher 
horizontal sequencies than with the two-dimensional trans- 
formation on its own, because of the increased horizontal 
separation of the samples in sub-sampled signals. 

Sampling at four-times subcarrier frequency would 
concentrate most of the colour signal energy into the 
quarter-sampling frequency coefficients although it would 
increase the word rate. If Af^^ were used, it is possible 
that some of the highest sequency coefficients could be 
omitted altogether to offset the increased word rate. 

All the methods which have been described of con- 
centrating the colour signal energy have some adverse 
effect, either on the distribution of luminance signal energy 
in the transform or on the word rate of the signal. If 
Fourier transformation were to be used, then the distri- 
bution of both colour and luminance signal energy would 
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be improved, although more compiicated transformation 
equipment would be required. 

It has been possible to check some of the results and 
assertions presented here using a real-time Walsh-Hadamard 
transformer. Groups of 32 samples taken sequentially 

and groups made up by sub-sampling at colour subcarrier 
rate were transformed. Also, a range of sampling fre- 
quencies from twice to three-times subcarrier frequency has 
been used.. In all cases, the number of most significant bits 
which were found to be unused was exactly as measured 
with the Walsh spectrum analyser. 

It was found, using the real-time transformer, that 
errors caused by the value of a coefficient exceeding the 
range allocated to it can be tolerated provided that the 
impairment is small and infrequent. For groups of 
sequential samples taken at three-times subcarrier rate, 
very few bits are used sufficiently infrequently to be 
removed without causing impairment, but, when sub- 
sampling is used, a larger number of bits may be removed. 
This is because high values occur much less frequently in 
the sub-sampled transform. Further, for this reason, non- 
linear quantisation cannot be used on the sequentially- 
grouped transform of colour signals with sampling at three- 
times subcarrier rate, but can be used successfully with the 
sub-sampling transformation. 

The results obtained with the real-time transformation 
system will be presented more fully in another report. ^"^ 



7. Conclusions 

Transforms of picture signals describe the relationships 
between picture elements instead of their individual values. 
The values of nearby picture elements are usually related, so 
it may be easier to reduce the bit-rate of the transform 
than to reduce that of the original signal. 

Walsh-Hadamard transformation is particularly attrac- 
tive for this purpose because the operations involved are 
simpler than for other transformations. The transfor- 
mation process has been described mathematically and 
illustrated with a typical example. The most efficient fast- 
transformation algorithm for television signals has been 
explained and a method of implementing the algorithm in 
digital circuits using a minimum of storage has been des- 
cribed. 

Although transformation increases the number of bits 
needed to represent a signal to full accuracy, the most 
significant bits of some coefficients are seldom or never 
used. The numbers of bits which are not used have been 
measured using a Walsh spectrum analyser for a wide range 
of signals. Signals containing large numbers of fast tran- 
sitions between black-level and white-level and signals con- 
taining high amplitudes of colour subcarrier produce the 
largest coefficients and therefore require more bits than 
other signals. Some of the least significant bits may be 
omitted because the amounts of energy which they repre- 
sent are negligibly small. However, the number of most 
and least significant bits which can be omitted is not by 



itself sufficient to offset the increase caused by the trans- 
formation. With this form of coding, it is expected that 
an average of between 8-5 and 9-0 bits per coefficient 
would be required to maintain the same accuracy as 8-bit 
p. cm. 

Ideally, a transformation should concentrate most of 
the energy of commonly occurring signals into a small 
number of transform coefficients. Then, the remaining 
coefficients will usually take small values, although occasion- 
ally they may take large values for unusual signals. A 
transform with these characteristics can be coded efficiently 
by describing the important coefficients accurately and then 
using non-linear quantisation or an adaptive system to des- 
cribe the other coefficients. 

For luminance signals, Walsh-Hadamard transfor- 
mation of sequentially grouped samples produces a distri- 
bution of energy in the transform which is reasonably 
suitable for bit-rate reduction. Most of the signal energy is 
carried by the low-sequency coefficients and the other 
coefficients take large values only rarely. However, the 
energy from colour subcarrier signals with sampling at 
three-times subcarrier rate is spread throughout the medium- 
and high-sequency functions. Large values of these coef- 
ficients are produced for a high proportion of the time, so 
that the transform is unsuitable for bit-rate reduction. 

Increasing the order of the transformation greatly 
increases the cost of the transformation equipment. It 
appears that for one-dimensional transforms of blocks of 
more than 64 samples the savings of bit-rate to be made are 
insufficient to justify the increase in cost. 

The distribution of energy in the transform can be 
changed by altering the rate at which the analogue signals 
are sampled. Choosing sampling frequencies such as twice 
or eight-thirds-times subcarrier frequency concentrates most 
of the colour signal energy into a small number of coef- 
ficients. Then the bit-rate of the other coefficients can be 
reduced more easily. 

Another method of improving the energy distribution 
is to transform groups of samples corresponding to two- 
dimensional blocks of picture elements. Then most of the 
luminance signal energy is concentrated into the low 
horizontal or vertical sequencies and the colour signal 
energy is confined to the middle vertical sequencies. An 
improvement is achieved because television signals are 
usually strongly related from line to line. This method 
could be combined with twice or eight-thirds-times sub- 
carrier-frequency sampling to further improve performance 
for colour signals. 

The maximum concentration of energy in the trans- 
form results if the basis functions are matched to the most 
commonly occurring television signals. Although Walsh 
functions are moderately good in this respect, it is expected 
that sinusoidal functions would be better. Therefore, 
Fourier transformation could lead to improved performance, 
but at the cost of more complicated transformation equip- 
ment. 
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Where possible, the assertions presented have been 
checked using a real-time transformation system. The 
performance of the real-time system is in close agreement 
with the performance predicted from measurements ob- 
tained by Walsh spectral analysis. 
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9. Appendix 
A Method of Reducing Redundancy in the Walsh- Hadamard Transform of Binary-Coded Signals 



Because of the nature of the Walsh- Hadamard trans- 
formation, the sets of code-words used to describe the 
transform of the signals contain redundancy. This 

Appendix presents a method by which the redundancy may 
be reduced without losing the characteristics of the trans- 
formation. 

At each stage in the fast transformation, two numbers, 
say A and B, are added and subtracted. Now if A and B 
are both even, or if A and B are both odd, both the sum 
and the difference will be even. If ^ is odd sndB is even, 
or if ^ is even and B is odd, then the sum and the difference 
will be odd. In terms of binary numbers this means that 
the least significant bits of the sum and the difference are 
always related, and with some representations of negative 
numbers are equal. Clearly, it is inefficient to transmit 
both least significant bits, so only one, say that of the sum, 
need be sent to the next stage of the transformation. At 
the corresponding stage in the inverse transformation, where 



A + B and A — B are added and subtracted to form 2A and 
2S, the appropriate value of the least significant bit of the 
difference can be formed from that of the sum, to ensure 
that the inverse transformation reproduces the input values 
exactly. 

If this operation is performed at each stage in 
the transformation, then the number of bits omitted 
from each coefficient is equal to the number of dif- 
ference operations used to calculate the coefficient. 
Also, errors are introduced only at the difference opera- 
tions, so the maximum value of the error in a coef- 
ficients falls within the range of the omitted bits. There- 
fore, the transform could be calculated in the normal 
way and truncation carried out in the transform do- 
main. Then it would be possible to return to the 
exact signal values using a modified inverse transfor- 
mation in which the correct values of the least significant 
bits are re-inserted at each stage. 



SMW/JUC 

(PH-144) 



30- 



